(19) 



3 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



(12) 



(n) EP 1 003 330 A1 

EUROPEAN PATENT APPLICATION 



(43) Date of publication: 

24.05.2000 Bulletin 2000/21 

(21) Application number: 99309147.9 

(22) Date of filing: 17.11.1999 



(51) Int CI7: H04N 3/15 



(84) Designated Contracting States: 


(72) Inventors: 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


• Perner, Frederick A. 


MC NL PT SE 


Palo Alto, CA94306 (US) 


Designated Extension States: 


• Tan, Charles M.C. 


AL LT LV MK RO SI 


Santa Clara, CA 95051 (US) 


(30) Priority: 18.11.1998 US 195588 


(74) Representative: Powell, Stephen David et al 




WILLIAMS, POWELL & ASSOCIATES, 


(71) Applicant: Hewlett-Packard Company 


4 St Paul's Churchyard 


Palo Alto, California 94304 (US) 


London EC4M SAY (GB) 



(54) Imaging system 

(57) A system (22) and a method for imaging a 
scene of interest utilize variable exposure periods that 
have durations based upon detecting a fixed voltage 
drop in order to determine the scene segment radiance. 
The rate (16, 18 and 20) of voltage drop corresponds to 
the degree of scene segment radiance, such that high 
radiant scene segments yield faster voltage drops than 
lower radiant scene segments. The variable exposure 
period is determined within each pixel (25) in a pixel ar- 
ray (24) of the system to gather exposure periods from 
different segments of the scene being imaged. The 
measured exposure periods are translated into gray- 



scale information that can be used to generate a com- 
posite image having various levels of grayscale that is 
representative of the imaged scene. Each pixel includes 
a photo sensor (36), an analog-to-digital converter (38, 
40, 68 and 78) and a memory (40) to measure, digitize 
and store the exposure period. The memory contains a 
number of memory cells (82 and 84) having a three-tran- 
sistor configuration that are each connected to a bi-di- 
rectional bit line (78). The bi-directional bit line functions 
as both a read bit line and a write bit line. The three- 
transistor configuration allows for non-destructive read- 
outs of data stored in the memory cells. 
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Description 

[0001] The invention relates generally to imaging sen- 
sors and more particularly to an imaging sensor utilizing 
CMOS active pixels having in-pixel local exposure con- 
trol. 

[0002] Active Pixel Sensors (APSs) are utilized in var- 
ious imaging devices, such as telescopes, digital cam- 
eras and video recorders. An APS captures an image 
of a scene of interest by converting incident light from ; 
the scene into electrical signals in an analog form. A typ- 
ical active pixel sensor has an array of "pixels" or dis- 
creet regions, each pixel containing a light-sensitive el- 
ement. Each light-sensitive element in a pixel generates 
a separate electrical current, which is proportional to the i 
intensity of the incident light on that element. The vary- 
ing magnitude of this elecmca! current is used asa basis 
for conversion into a stream of digital image data by an 
analog-to-digital converter (ADC), v/hich can be stored 
in memory. The digitized imrige data from all the pixels 2 
can then be displayed as n composite image on a mon- 
itor, printed onto a sheet ot p«pcr or analyzed for infor- 
mation concerning the properties of objects in the 
scene. 

[0003] The pixels that arc uttli/cd m conventional 2; 
APSs can be classified into two typos ol pixels. The first 
type of pixel is commonly referred to as an "analog pixel. 
" An analog pixel includes a photo sensor, such as a 
photodiodeoraphototransistor andmriy include an am- 
plifier. An associated ADC and memory are located ex- 3i 
ternal to the pixel. Therefore, any current generated by 
the photo sensor of an analog pixel is transmitted from 
the pixel to the external ADC as an analog signal. 
[0004] The second type of pixel is known as a "digital 
pixel." A digital pixel includes not only a photo sensor 3S 
and an amplifier, but also an ADC. In other words, the 
ADC is contained within the pixel, along with the photo 
sensor and the amplifier. Thus, the magnitude of current 
generated by the photo sensor is digitized within the pix- 
el and can be transferred to off-pixel components as a 40 
digital signal. U.S. Pat. No. 5,461,425 to Fowler et al., 
entitled "CMOS Imaging Sensor with Pixel Level A/D 
Conversion," describes an imaging sensor on a single 
semiconductor chip having pixels of the second type. 
The imaging sensor of Fowler et aJ. has an array of pix- 4S 
els, wherein each pixel includes a phototransistor and 
an ADC. The analog signal generated by the phototran- 
sistor is converted to a serial stream of digital data bits 
by the on-pixel ADC. The digital data is then filtered and 
stored in an external memory. The on-pixel ADC is de- so 
scribed as having the advantage of minimizing parasitic 
effects and distortion caused by low signal-to-noise ra- 
tio. 

[0005] The prior art active pixel sensors, regardless 
of the pixel type, operate to image a scene of interest ss 
by quantifying the degrees of radiance from various 
scene segments. For each scene segment, a particular 
pixel quantifies the degree of radiance from the scene 
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segment by measuring a photo voltage driven by a pho- 
to-sensor-generated current. When a photo sensor is 
exposed to incident light from a segment of the scene 
for a fixed integration or exposure time period, the mag- 
nitude of a photo voltage will be dependent upon the 
intensity of radiance from the scene that is being imaged 
by the photo sensor. 

[0006] Fig. 1 illustrates the technique utilized by the 
prior art imaging sensors to quantify the intensity of ra- 
> diance from a scene segment. Referring to Fig. 1 , three 
lines 10, 12 and 14 are plotted with respect to voltage 
overtime. The lines 10, 12 and 14 represent photo volt- 
ages corresponding to three degrees of radiance from 
the scene segment that is sensed by a prior art imaging 
sensor. The time period from t=0 to t=T is the fixed ex- 
posure time period utilized by the imaging sensor. The 
line 10 represents the voltages over time when the de- 
gree of radiance from the scene segment is the maxi- 
mum level detectable by the imaging sensor. The line 
1 4, on the other hand, represents the voltages over time 
when the degree of radiance from the scene segment 
is at the minimum level detectable by the imaging sen- 
sor. Lastly, the line 12 represents the voltages overtime 
when the degree of radiance from the scene segment 
is at the mean illumination level. 

[0007] At the end of the fixed exposure period, i.e., 
t=T, the imaging sensor quantifies the magnitude of the 
photo voltage using an ADC. When the degree of radi- 
ance from the scene is at the detectable maximum level, 
the voltage equals V SAT , as indicated by the line 10 at 
t=T. At the mean illumination level, the voltage is V MEAN , 
as indicated by the line 12 at t=T. Lastly, at the detecta- 
ble minimum level, the voltage is V RESET , as indicated 
by the line 14 at t=T. The imaging sensor configured to 
the limits defined by V SAT and V RESET will be able to 
differentiate discrete degrees of scene radiance that re- 
sult in a photo voltage between V SAT and V RESET . How- 
ever, the amount of differentiate degrees of scene ra- 
diance that can be detected by an imaging sensor is at 
least partially dependent on the resolution of the ADC. 
As another factor that affects image quality, the radiance 
sensitivity may be adjusted by shortening or extending 
the length of the fixed exposure period, but the adjust- 
ment is a tradeoff of increasing sensitivity of either high 
radiant scene segments or low radiant scene segments. 
[0008] Although the prior art imaging sensors operate 
well for their intended purpose, what is needed is an im- 
aging sensor having a superior imaging performance, 
as defined by its dynamic range, and a greater sensitiv- 
ity to low radiant scene segments. 
[0009] A system and a method for imaging a scene of 
interest determine a scene segment radiance based up- 
on time periods ("exposure periods") required to 
achieve a fixed voltage drop. Thus, rather than the con- 
ventional technique of sampling the voltage level after 
each set exposure time (i.e., time-driven sampling), 
sampling data is based on the time required for a set 
voltage drop (i.e., voltage-driven sampling). The volt- 
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age-driven sampling occurs at each pixel in a pixel array 
that is used to provide image information in discrete 
scene segments. The rate of voltage drop corresponds 
to the intensity of scene segment radiance, such that 
high radiant scene segments yield more rapid voltage 
drops than lower radiant scene segments. The variable 
exposure periods are measured for each pixel in the pix- 
el array to gather exposure periods from different seg- 
ments of the scene being imaged. The measured expo- 
sure periods are then translated into grayscale informa- 
tion that can be used to generate a composite image 
having various levels of grayscale that are representa- 
tive of the imaged scene. 

[0010] The variable exposure period is measured 
within each pixel by comparing the voltage at a floating 
diffusion (FD) node to a reference voltage. The voltages 
at the FD node and the reference voltage are input to a 
comparator that outputs a signal when the voltage at the 
FD node is equal to or less than the reference voltage. 
The FD node is connected to a photo sensor, e.g., pho- 
todiode, to generate a photo current in response to in- 
cident light from an associated scene segment. The 
generated current causes dissipation of charge from an 
integration capacitor connected to the FD node, causing 
the voltage at the FD node to decrease. The rate of de- 
crease in voltage at the FD node is accelerated if the 
magnitude of the photo current is increased. Therefore, 
the time period for the voltage at the FD node to drop 
from a reset voltage to the reference voltage is mathe- 
matically related to the radiance of the scene segment 
from which the pixel receiy^es4ie^eoeray. This time pe- 
riod defines the expostfreperiod for theScejie segment 
being i 

[001 IJXThe duration of the exposure period is tFten dig 
for signal processing. In the preferred embodi 
nent, each pixel includes an analog-to-digital convei 
(ADC) to digitize the duration of the exposure peri 
within the pixel. The ADC is designed to capture a digital 
count that is supplied, by an off-pixel counter. The cap- 
tured digital count represents the exposure period for 
the scene segment being imaged. The off-pixel counter 
may- be configured to provide linearly progressing dig- 
ital counts. However, the off-pixel counter may also bej 
configured to provide non-linear digital counts. The non- 
Jinear digital counts may be utilized to change the rela- 
tionship between the exposure period and the deo/ee 
of radjance from a scene segment 
[001 2] N Sn this preferred embodiment, each pix^l also 
includes merPtOQTto store the captured digitalcoxint. The 
in-pixel memory corTta4ns3jT Ujriber qjjjiemory cells that 
can store the captured digital count. Preferably, the 
number of memory cells is at least as great as the 
number of bits in the digital count. The memory cells are 
configured such that each memory cell is coupled to a 
bi-directional bit line. The bi-directional bit line functions 
as both a read bit line and a write bit line. 
[0013] The memory cells are dual port memory cells 
having a three-transistor configuration. Each memory 



cell includes a write access transistor, a read access 
transistor, and a data-controlled transistor. The read ac- 
cess transistor and the data-controlled transistor are 
configured to provide a conductive path from an asso- 

s ciated bi-directional bit line to ground. The write access 
transistor connects the bi-directional bit line to the gate 
of the data-controlled transistor. A storage node is lo- 
cated between the write access transistor and the gate 
of the data-controlled transistor. Thus, the data stored 

10 jn the storage node can control the conductive state of 
the data-controlled transistor. During a read operation, 
the stored data in the storage node is indirectly read by 
the effect of the conductive state of the data-controlled 
transistor. Therefore, the stored data is not destroyed 

is during the read operation. The non-destructive feature 
of the memory cell allows less frequent refresh cycles, 
or no refresh requirement for high speed read-out appli- 
cations. 

[0014] An advantage of the invention is that each pixel 
20 contains an electronic shutter in which all the pixels si- 
multaneously sense, digitize, and store digital image da- 
ta in response to a scene being imaged. Thus, the pixels 
output digital signals, rather than analog signals. In ad- 
dition, the pixels can store the digital image data for an 
25 indefinite period, and thereby functions as an image 
frame buffer. 

[0015] Another advantage of the invention is that a 
greater dynamic range is achieved, which equates to su- 
perior imaging performance. Still another advantage is 

so that sensitivity for low radiant scene segments are in- 
creased with the use of variable exposure periods. Fur- 
thermore, the pixel design is compatible with scaled 
CMOS technologies with a low supply voltage. 
[0016] Fig. 1 is a voltage-time graph showing three 

35 lines that represent different degrees of radiance from 
a scene segment detected by a prior art imaging system 
utilizing a fixed exposure period technique. 
[0017] Fig. 2 is a voltage-time graph showing three 
lines that represent different degrees of radiance from 

40 a scene segment detected by an imaging system utiliz- 
ing a variable exposure period technique in accordance 
with the present invention. 

[001 8] Fig. 3 is a block diagram of an imaging system 
in accordance with the present invention. 

45 [0019] Fig. 4 is a schematic diagram of a imaging pixel 
circuit in accordance with the present invention. 
[0020] Fig. 5 is a schematic diagram of a pair of mem- 
ory cells utilized in the imaging pixel circuit of Fig. 4 cou- 
pled to bi-directional bit lines in accordance with the 

50 present invention. 

[0021] Fig. 6 is a schematic diagram of a sense am- 
plifier circuit in accordance with the present invention. 
[0022] Fig. 7 is a timing diagram for a refresh opera- 
tion of the imaging pixel circuit of Fig. 4. 

55 [0023] Fig. 8 is a block diagram showing a pixel pair 
in accordance with the preferred embodiment of the 
present invention. 

[0024] Fig. 9 is a flow diagram illustrating a method of 
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imaging a scene of interest in accordance with the 
present invention. 

[0025] With reference to Fig. 2 : three lines 16,18 and 
20 are plotted with respect to voltage over time, illustrat- 
ing the fundamental concept utilized by the present in- 
vention to perform an imaging operation. Unlike conven- 
tional imaging sensors that utilize a fixed exposure pe- 
riod, an imaging sensor in accordance with the present 
invention measures the duration of a variable exposure 
time period to determine the degree of radiance from a 
scene segment. The measured exposure period is the 
time period that is required for a photo-sensor-generat- 
ed current to discharge from a fixed reset voltage to a 
fixed reference voltage. 

[0026] In Fig. 2, the reset voltage and the reference 
voltage are defined as V RESET and V REF , respectively. 
Line 16 represent changes in voltage when the degree 
of radiance from a scene segment is the maximum level 
detectable by the present invention, whereas line 20 
represents changes in voltage when the degree of radi- 
ance from a scene segment is the minimum level. Line 
18 represents changes in voltage when the degree of 
radiance from a scene segment is at the mean illumina- 
tion of the entire scene to be imaged. The slopes of lines 
16,18 and 20 are defined by the magnitude of a photo- 
sensor-generated current. However, the magnitude of 
the current is proportional to the degree of radiance from 
the scene segment. Therefore, a mathematical relation- 
ship exists between the degree of radiance from a scene 
segment and the slope of a line representing a change 
in voltage. Higher radiance levels equate to steeper 
negative slopes, which result in more rapid decreases 
in voltage from V RESET to V REF . 
[0027] At the maximum radiance level, the voltage 
has decreased from V RESET to V REF when t=T v as in- 
dicated by the line 16 at v=V REF . At mean illumination 
radiance, the voltage has reached V REF at t=T 2 , as in- 
dicated by the line 18atv=V REF . Lastly, at the minimum 
radiance level, the voltage has reached V REF at t=T 3 , as 
indicated by the line 20 at v=V REF . The three time peri- 
ods defined by T v T 2 and T 3 represent the exposure 
periods for the three degrees of radiance. Thus, any 
scene segment having a degree of radiance between 
the maximum level and the minimum level will have an 
exposure period that ends between t=^ and t=T 3 . By 
quantifying the time period for the voltage to drop from 
v reset to v rep tne degree of radiance can be deter- 
mined in which a shorter exposure period equates to 
higher radiance. 

[0028] The value of V REF with respect to V RESET af- 
fects the performance of the imaging sensor utilizing the 
variable exposure period technique. A high value of 
V REF , or a small change in voltage between V RESET and 
v ref> wi " y' e 'd a faster photo sensor response time than 
a low value of V REF . However, the performance of the 
imaging sensor will be limited by sensor noise and by 
the maximum counter clock frequency allowed by a dig- 
itizer circuitry. On the other hand, a low value of V REF 



will provide a signal that is less degraded by sensor 
noise, but the sensor response will be slower. 
[0029] With reference to Fig. 3, an imaging system 22 
in accordance with the present invention is shown. Pref- 
5 erably, the imaging system 22 is manufactured on a sin- 
gle semiconductor chip. The imaging system 22 utilizes 
the above-described technique of quantifying a variable 
exposure period to determine the degree of radiance 
from a scene segment. The imaging system 22 includes 
io an array 24 of pixels 25. Each pixel 25 is designed to 
measure an exposure period in response to the degree 
of radiance from a scene segment and then digitize the 
measured exposure period. In addition, each pixel 25 is 
capable of storing the digitized data that represents the 
« measured exposure period. The imaging system 22 fur- 
ther includes a row decoder 26, a read-write-and-re- 
fresh (RWR) circuit 28, a column decoder 30, and a con- 
trol unit 32. 

[0030] The row decoder 26 is configured to select a 
20 row of pixels 25 in the array 24 during a read, write or 
refresh operation. Similarly, the column decoder 30 op- 
erates to select a column of pixels 25 during one of the 
previously mentioned operations. The RWR circuit 28 is 
designed to direct the flow of data between the pixels 
2S 25 and the control unit 32. In addition, RWR circuit 28 
includes circuitry necessary to refresh data stored within 
the pixels 25. The control unit 32 provides the necessary 
control and timing signals to the RWR circuit 28 : the de- 
_ coders 26 and 30, and the pixels 25. 
30 [0031] Turning to Fig. 4, an imaging pixel circuit 34 
having in-pixel local exposure control that can capture, 
digitize and store image data from a scene of interest is 
shown. The imaging pixel circuit 34 is contained within 
each of the pixels 25 in the array 24 of Fig. 3. The pixel 
3S circuit 34 includes a photodiode 36, a comparator 38, a 
dynamic buffer memory 40 and supporting circuitry. The 
photodiode 36 is coupled between a P-channel metal- 
oxide-semiconductor (PMOS) transistor 42 and electri- 
cal ground. The PMOS transistor 42 functions as a reset 
40 switch to connect the photodiode 36 to a V RESET volt- 
age. The V RESET voltage is supplied to the PMOS tran- 
sistor 42 by an external source (not shown). A RESET 
signal, applied to the gate of PMOS transistor 42, acti- 
vates or deactivates the PMOS transistor 42. A floating 
45 diffusion (FD) node 44 connects the junction of the 
PMOS transistor 42 and the photodiode 36 to the com- 
parator 38. The voltage at the FD node is the critical 
voltage that will be monitored to determine the exposure 
period for a scene segment to be imaged. Also connect- 
60 ed to FD node 44 is an integration capacitor 46. The 
capacitor 46 is a built-in capacitor that is formed by the 
devices surrounding the FD node 44. 
[0032] The comparator 38 consists of two gate-cou- 
pled PMOS transistors 48 and 50 that are connected to 
ss a supply voltage VDD. AMOS transistor 52 is connected 
in series with the PMOS transistor 48, while a MOS tran- 
sistor 54 is connected in series with the PMOS transistor 
50. The gate of MOS transistor 52 is connected to the 



BNSDOCID: <EP 1 003330A 1 _!_> 



7 



EP 1 003 330 A1 



8 



FD node 44. However, the gate of MOS transistor 54 is 
connected to an external circuitry (not shown) to receive 
a V REF voltage. The MOS transistors 52 and 54 are cou- 
pled to a MOS transistor 56 such that the transistors 48 
and 52 provide a first conductive path from VDD to the 
transistor 55 and transistors 50 and 54 provide a second 
conductive path from VDD to the transistor 56. The gate 
of transistor 56 is coupled to the gates of PMOS tran- 
sistors 48 and 50. A transistor 58 connects the transistor 
56 to ground. The transistor 58 is controlled by a CLK 
signal, which controls the activation and deactivation of 
the comparator 3B. 

[0033] The comparator 38 operates to indicate the 
voltage at FD node 44 with respect to the V REF voltage. 
If the voltage at FD node 44 is greater than the V REF 
voltage, the comparator 38 outputs a high signal at an 
output terminal 60. When the voltage at FD node 44 is 
equal to or less than the V REF . voltage : the comparator 
38 outputs a low signal at the output terminal 60. How- 
ever, when a low CLK signal is provided to the gate of 
transistor 58, no current is allowed to flow through the 
comparator 38, deactivating the comparator 38. The 
lack of current flow results in a high signal at the output 
terminal 60, regardless of the voltage at FD node 44. A 
high CLK signal activates the comparator 38 to monitor 
the voltage at FD node 44 with respect to the V REF volt- 
age. 

[0034] Connected to the output terminal 60 is a pair 
of transistors 62 and 64. The transistor 62 is a PMOS 
transistor. The gates of transistors 62 and 64 are cou- 
pled to the output terminal 60. The transistors 62 and 
64 are connected in series between VDD and ground. 
The transistor 62 is connected to VDD, while the tran- 
sistor 64 is connected to ground. The transistors 62 and 
64 operate to invert a signal on the output terminal 60 
and transmit the inverted signal to a gate terminal 66 
that is connected to a node between the transistors 62 
and 64. 

[0035] The inverted signal on the gate terminal 66 can 
drive a pre-charged high signal on a write word line 
(WWL) 68 to a low signal, depending upon the inverted 
signal. This is accomplished by a PMOS transistor 70 
and a transistor 72 that provide a conductive path from 
VDD to ground. The gate of PMOS transistor 70 is con- 
figured to receive the RESET signal to control the con- 
ductive state of the PMOS transistor 70. The gate of 
transistor 72 is connected to the gate terminal 66. The 
RESET signal, that turns "on" the PMOS transistor 42, 
pre-charging the voltage at FD node 44 to V RESET , also 
turns "on" the PMOS transistor 70, pre-charging the volt- 
age at the WWL 68 to VDD. When the voltage at the 
gate terminal 66 changes from a low signal to a high 
signal, the transistor 72 is activated. The activation of 
the transistor 72 drives the high signal on the WWL 68 
from the high signal to a low signal. However, a low sig- 
nal on the gate terminal 66 will not affect the signal on 
the WWL 68. 

[0036] The WWL 68 is coupled to a PMOS transistor 



74 that can also connect the WWL 68 to VDD. The 
PMOS transistor 74 is controlled by a word line access 
(WLA) signal that is supplied to the gate of transistor 74. 
Also coupled to the WWL 68 is a transistor 76 that can 
s connect the WWL 68 to ground. A write terminate (WT) 
signal is supplied to the gate of transistor 76 to control 
the connection of WWL 68 to ground. The WLA and WT 
signals are utilized during refresh and write operations. 
[0037] The WWL 68 extends to the dynamic buffer 
10 memory 40. Coupled to the dynamic buffer memory 40 
are a number of bi-directional bit lines (BLs) 78. The bi- 
directional BLs 78 are able to carry bits ol digital counts 
from an external counter (not shown) to the dynamic 
buffer memory 40. In addition, the bi-directional BLs 78 
is are configured to carry stored data from the dynamic 
buffer memory 40 to the RWL circuit 28. Contained with- 
in the dynamic buffer memory 40 are memory cells that 
can store digital data, such as a digital count. The 
number of memory cells corresponds to the number of 
bi-directional BLs 78. As an example, the number ol 
memory cells and bi-directional BLs 78 may be sixteen. 
Thus, in this example, the dynamic buffer memory 40 is 
a 16-bit dynamic buffer memory that can store a 16-bit 
digital count. Also connected to the dynamic buffer 
memory 40 is a read word line (RWL) 80. The RWL 80 
and WWL 68 are connected to the memory cells within 
the dynamic buffer memory 40 to access the memory 
cells for retrieval and storage of data. The primary func- 
tion of the dynamic buffer memory 40 is to capture and 
store a particular digital count when the voltage at FD 
node 44 has dropped to V REF . The captured digital count 
represents the exposure period that can be used to de- 
termine the degree of radiance from a scene segment 
being imaged. 

[0038] With reference to Fig. 5, two memory cells 82 
and 84 of the dynamic buffer memory 40 are illustrated. 
However, the dynamic buffer memory 40 may include 
sixteen or more memory cells, identical to the memory 
cells 82 and 84. The memory cell 82 is comprised of 
transistors 86, 88 and 90. A storage capacitor 92 is 
shown to be a component of the memory cell 82 to illus- 
trate the capacitance at a storage node 94. The transis- 
tor 86 is connected between the bi-directional BL 78 and 
the storage node 94. The gate of transistor 86 is coupled 
to the WWL 68. The transistor 86 is a write access tran- 
sistor that must be activated to write data into the mem- 
ory ceil 82. The transistors 88 and 90 provide a conduc- 
tive connection from the bi-directional BL 78 to ground. 
The gate of transistor 90 is coupled to the RWL 80, while 
the gate of transistor 88 is coupled to the storage node 
94. Thus, the conductive state of the transistor 88 is con- 
trolled by a bit of data stored in the capacitor 92, when 
the bi-directional BL 78 is pre-charged to a high signal 
and the transistor 90 is activated. The transistor 90 is a 
read access transistor that must be activated to read the 
stored data in the memory cell 82. The memory cell 84 
is identical to the memory cell 82. The memory cell 84 
includes transistors 96, 9B and 100 and a storage ca- 
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pacitor 1 02 at a storage node 1 04. 
[0039] The read and write operations of the memory 
cells 82 and 84 will be described in reference to only the 
memory cell 82. The operations of the memory cell 84 
and other memory cells in the dynamic buffer memory s 
40 are identical to the operations of the memory cell 82. 
A write operation simply involves transmitting data to be 
stored through the bi-directional BL 78 and then apply- 
ing a high signal to the WWL 68, activating the transistor 
86. The activation of the transistor 86, connecting the io 
capacitor 92 to the bi-directional BL, writes data from 
the bi-directional BL 78 to the capacitor 92. The deacti- 
vation of the transistor 86, thereafter, captures the data 
in the capacitor 92. A read operation involves pre-charg- 
ing the bi-directional BL 78 to a high signal and activat- is 
ing the transistor 90. Depending upon the data stored 
in the capacitor 92, the high signal on the bi-directional 
BL 78 will be either pulled low or maintained high. A high 
signal, i.e., a "1 ", stored in the capacitor 92 will activate 
the transistor 88 when the transistor 90 is turned "on." 20 
The activation of both transistors 88 and 90 connects 
the bi-directional BL 78 to ground, pulling the high signal 
on the bi-directional BL 78 to a low signal. However, if 
a low signal, i.e., a "O", is stored in the capacitor 92, the 
transistor 88 will not be activated when the transistor 90 2s 
is turned "on. n Thus, the high signal on the bi-directional 
BL 78 will remain high. Therefore, the signal on the bi- 
directional BL 78, after the activation of transistor 90, is 
the inverse of the signal stored in the capacitor 92 as 
data. 30 

[0040] The memory cells of dynamic buffer memory 
40 are dynamic random access memory (DRAM) cells. 
These memory cells allow the stored data to be read 
without destroying the stored data in the process, since 
the stored data is applied only to gates of transistors. 35 
The non-destructive feature of the memory cells re- 
quires less frequent refresh cycles, or no refresh oper- 
ation for high speed read-out applications. Therefore, 
the memory cells can be read numerous times without 
the need to refresh the stored data. However, the mem- 40 
ory cells will need to be refreshed at some point if data 
is stored in the memory cells for a long period of time. 
Since stored data is read from the memory cells as in- 
verted signals of the stored data in the memory cells, 
the signals that must be written back into the memory 45 
cells must be the inverse of the read signals, i.e., the 
original stored data. 

[0041] In order to satisfy this requirement, each mem- 
ory cell of dynamic buffer memory 40 is connected to a 
corresponding sense amplifier circuit, such as a sense so 
amplifier circuit 1 06 shown in Fig. 6. The sense amplifier 
circuits are included in the RWR circuit 28 of Fig. 3. For 
illustration purposes, the sense amplifier circuit 106 will 
be described as if it is connected to the memory cell 82. 
The sense amplifier circuit 106 includes a weak feed- ss 
back latch 1 08, an inverter 1 1 0 and transistors 112,114, 
116 and 118. The latch 108 is comprised of a large in- 
verter 1 20 and a smaller inverter 1 22 on a feedback 1 24. 



The inverters 120 and 122 operate to hold a signal on 
an input node 126. The latch 108 is connected to a data 
bus 128. The data bus 128 provides an output path for 
data stored in the memory cell 82 during a read opera- 
tion. The data bus 128 provides an output path from the 
memory cell 82 to the control unit 32 of Fig. 3. The tran- 
sistor 118, that is controlled by a BD_gate signal, con- 
nects the latch 108 to the data bus 128. The latch 108 
can also be conductively connected to the bi-directional 
BL 78 through one of two paths 1 32 and 1 34. The path 
132 is conducting when the transistor 114 is activated 
by an R_gate signal, whereas, the path 134 is conduct- 
ing when the transistor 1 1 6 is activated by a control write 
enable (CWE) signal. A third path 130 connects the BL 
78 to VDD when the transistor 112 is activated by a 
BLOAD signal. Included on the path 134 is the inverter 
110 that inverts sensed data from the memory cell 82 
back to the original stored data during a refresh opera- 
tion. One of the paths 1 32 and 134 also provides a con- 
nection between the bi-directional BL 78 to a write bit 
line (WBL) 136. The WBL 136 is connected to the ex- 
ternal counter to receive digital count data. In addition, 
the WBL 136 may be connected to an off-chip external 
device (not shown) to receive data that is to be written 
into the memory cell 82. The data to be written may be 
the read-out data from the memory cell 82 that has been 
modified by the off-chip external device. 
[0042] The image capturing operation ofthe imaging 
system 22 will be described with reference to Figs 3-6. 
The image capturing operation is simultaneously per- 
formed within each pixel 25 in the array 24 of Fig. 3. 
Each pixel 25 performs the image capturing operation 
in an identical manner. Initially, V REF is supplied to the 
comparator 38 of Fig. 4 at the gate of transistor 54. The 
RESET signal is then set low to reset the voltage at FD 
node 44 to V RESET and the voltage at WWL 68 to VDD. 
The resetting of the voltage at WWL 68 to VDD equates 
to a high signal on WWL 68, which activates the write 
access transistors in the memory cells of the dynamic 
buffer memory 40. Next, the RESET signal is switched 
to a high signal, turning "off" the PMOS transistors 42 
and 70, and isolating FD node 44 and the WWL 68. The 
high RESET signal marks the beginning of a variable 
exposure period for all the pixels 25 in the array 24. 
Meanwhile, a high CWE signal is supplied to the tran- 
sistor 116 of the sense amplifier circuit 106 of Fig. 6, as 
well as to all identical transistors of other sense amplifier 
circuits corresponding to the memory cells of dynamic 
buffer memory 40. The activation of transistor 1 1 6 of the 
sense amplifier circuit 1 06 and other identical transistors 
in the corresponding sense amplifier circuits provides 
conductive connections between the dynamic buffer 
memory 40 to the external counter via the bi-directional 
BLs 78. The conductive connections allow the external 
counter to transmit digital counts to the dynamic buffer 
memory 40. The external counter is initiated to sequen- 
tially transmit the digital counts at the start of the expo- 
sure period. 
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[0043] At the start ot the exposure period, the voltage 
at FD node 44 is V RESET , which is greater than V REF . 
The comparator 38, activated by a high CLK signal, pro- 
vides a high signal at the output terminal 60. The high 
signal at the output terminal 60 turns "on" the transistor 
64 that connects the gate terminal 66 to ground, gener- 
ating a low signal on the gate terminal. The low signal 
on the gate terminal 66 does not turn "on" the transistor 
72. Thus, the high signal on the WWL 68 remains high. 
The consistent high signal on WWL 68 maintains the 
conductive state of the write access transistors in the 
memory cells of the dynamic buffer memory 40. There- 
fore, the storage capacitors of memory cells are able to 
receive sequential digital counts Irom the external coun- 
ter. The imaging pixel circuit 34 will remain in this state 
until the voltage at FD node 44 drops to V REF . 
[0044] During the exposure period, the voltage at FD 
node 44 decreases from V RESEX in response to a current 
generated by the photodiode 36. The rate of decrease 
in voltage at FD node 44 is a function of the intensity of 
incident light that impinges the photodiode 36. The in- 
tensity of incident light will vary in accordance to the de- 
gree of radiance from a scene of interest. When the ra- 
diance is high, the photodiode 36 generates a large cur- 
rent due to the increase in the intensity of incident light 
upon the photodiode 36. The large current causes the 
capacitor 46 to discharge, lowering the voltage at FD 
node 44. However, if the radiance from the scene is low- 
er in magnitude, the photodiode 36 will generate a small- 
er current. The smaller current also causes the capacitor 
46 to discharge and lower the voltage at FD node 44, 
but at a slower rate. 

[0045] When the voltage at FD node 44 falls to V REF , 
the comparator 38 generates a low signal to the output 
terminal 60. The low signal at the output terminal 60 de- 
activates the transistor 64 and activates the PMOS tran- 
sistor 62. The activation of transistor 62 pulls the low 
signal on the gate terminal 66 to a high signal. The high 
signal on the gate terminal 66 then activates the tran- 
sistor 72, connecting WWL 68 to ground. Thus, the high 
signal on WWL 68 is converted into a low signal, turning 
"off" the write access transistors in the memory cells of 
the dynamic buffer memory 40. The deactivation of write 
access transistors -captures" the latest digital count that 
was transmitted from the external counter. The external 
counter continues to transmit additional digital counts. 
However, the subsequent digital counts do not affect the 
captured digital count stored in the dynamic buffer mem- 
ory 40. The image capturing operation is terminated af- 
ter a predetermined time that is referenced from the start 
of the exposure period. 

[0046] Although the CLK signal may be held high dur- 
ing the entire period between the start of the exposure 
period and the termination of the image capturing oper- 
ation, the CLK signal may be comprised of a series of 
pulses to decrease power dissipation by the current 
drain caused by the activation of the comparator 38. The 
CLK signal may be synchronized to a duty cycle, such 



digital 



that the CLK signal is high for a short period in between 
the times when the digital counts are received by the 
dynamic buffer memory 40. Thus, the voltage at FD 
node 44 will be compared only during these short mo- 
5 ments when the comparator 38 is activated. By utilizing 
the duty cycle, the power dissipation of the imaging pixel 
circuit 34 can be significantly lowered. For example, if 
0.2 u7\ is needed for each pixel, 200 mA would be re- 
quired for a million pixel sensor array. However, if the 
io CLK signal is synch ronized to a d uty cycle of 1%, the 
required currep**vtf6TJS^ 
[0047].-^lfl 5 a non-complex embodiment? 
count^fhat are provided by the external counter arfcvjin- 
ear^counts. Furthermore, the V REF that is used to corr> 
is pare the falling voltage at FD node 44 is a constant sig- 
nal. In a more complex embodiment, one or both of 
these features is/are modified. The external counter 
may be implemented with a non-linear clock period to 
change the relationship of exposure period and the de- 
gree of radiance from a scene of interest. For example, 
the external counter may utilize a bgarithmic period to 
generate logarithmic digital counts. The captured digital 
count by a pixel will then have a logarithmic relationship 
with the exposure period, resulting in a more balanced 
25 \grayscale resolution forthe range of radiance intensities 
the scene being imaged. In addition, the V REF may/ 
provided as a non-linear signal. As an example,^th 
V REF signal may increase with time in order to shorten 
a poten^aHyJong exposure period associated -with low 

30 radiant scenes^"^— — — —-"""""^ 

[0048] Turning to Fig. 7, a timing diagram for a refresh 
operation of the imaging system 22 of Fig. 3 is shown. 
The refresh operation will be described with reference 
to Figs. 3-6, in addition to Fig. 7. Initially, a row of pixels 
35 25 in the array 24 is selected by the row decoder 26 to 
refresh the memory cells within each pixel of the row. At 
t=Tl , a high BLOAD signal is supplied to the transistor 
1 1 2 in the sense amplifier circuit 1 06 of Fig. 3 and iden- 
tical transistors in other sense amplifier circuits that are 
40 connected to each memory cell in the selected array 
row. The activation of BLOAD-signal-controlled transis- 
tors connects the bi-directional BLs 78 that are associ- 
ated with the memory cells to VDD, pre-charging the bi- 
directional BLs high. 
45 [0049] At t=T2, the BLOAD signal drops to a low sig- 
nal, deactivating the BLOAD-signal-controlled transis- 
tors. Next at t=T3, a signal on a read word line, such as 
the FtWL 68, is switched to a high signal from a low sig- 
nal, turning on the read access transistors of the mem- 
so ory cells in the selected array row. The activation of read 
access transistors allows stored data in each memory 
cell to either pull down the pre-charged high signal on 
the bi-directional BL 78 to a low signal or leave the high 
signal unchanged. A high signal, i.e., a "1 " , stored in a 
ss memory cell will pull down the high signal on a bi-direc- 
tional BL to a low signal. However, a low signal, i.e., a 
"0", stored in a memory cell will not change the high sig- 
nal on a bi-directional BL Thus, the resulting signal on 
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the bi-directional BLs 78 reflects the stored data in an 
inverted form. At t=T4, a high R_gate signal is supplied 
to the transistor 1 1 4 and other identical transistors in the 
sense amplifier circuits, connecting the bi-directional 
BLs 78 to the weak feedback latches in the sense am- 
plifier circuits. The weak feedback latches hold the in- 
verted signals from the bi-directional BLs 78. 
[0050] Next at t=T5, the read access transistors and 
the FLgate-signal-controlled transistors are deactivated 
by pulling down the high signal on the read word line 
and switching the R_gate signal to a low signal. At t=T6 
the CWE signal is switched from a low signal to a high 
signal, activating the transistor 116 and other identical 
transistors in the sense amplifier circuits. The inverted 
signals held by the weak feedback latches are convert- 
ed to correspond to the original stored data in the mem- 
ory cells by the inverter 1 1 0 and other identical inverters 
in the sense amplifier circuits. The converted signals are 
transmitted to the bi-directional BLs by the activation of 
CWE signal controlled transistors. Next at t=T7, the 
WLA signal is switched from a high signal to a low signal 
turning "on" the PMOS transistor 74 of Fig. 4 and other 
identical PMOS transistors in the selected pixels. The 
activation of WLA-signal-controlled transistors connects 
the write word lines, such as the WWL 68, to VDD. The 
VDD on write word lines turns "on" the write access tran- 
sistors in the memory cells of the selected pixels The 
activation of write access transistors allows the convert- 
ed signals from the sense amplifier circuits to be written 
into the memory cells. 

[0051] At t=T8, the WLA is switched back to a high 
signal, disconnecting the write word lines from VDD. At 
t=T9, the CWE signal is pulled low to deactivate the 
CWE-signal-controlled transistors, isolating the memo- 
ry cells from the sense amplifier circuits. Furthermore, 
a high WT signal is provided to the transistor 76 and 
other identical transistors in the pixels, to pull down the 
high signal on the write word lines to deactivate the write 
access transistors. At t=10. the WT signal is switched 
into a low signal, turning "off" the WT-signal-controlled 
transistors. Lastly, at t=11, the refresh cycle may be re- 
peated. 

[0052] In the preferred embodiment, the pixels 25 of 
Fig. 3 are configured as pixel pairs that share their pixel 
spaces to accommodate the two dynamic buffer mem- 
ones utilized by the two pixels in each pixel pair With 
reference to Fig. 8, a pixel pair 1 38 in accordance to the 
preferred embodiment is shown. The pixel pair 138 in- 
cludes a left pixel 1 40 and a right pixel 1 42. The left pixel 
1 40 utilizes an upper dynamic buffer memory 1 44 while 
the right pixel 142 utilizes a lower dynamic buffer mem- 
ory 146. Half of the buffer memory 144 is located in the 
left pixel 140. The other half of the buffer memory 144 
is located in the right pixel 142. Similarly, the buffer 
memory 146 is located in both the left and right pixels 
140 and 142. This configuration minimizes the size of 
the pixels and allows the buffer memories to have suffi- 
cient storage capability for a large digital count In this 



preferred embodiment, the reading and writing opera- 
tion includes sequentially selecting a row of pixels 25 in 
the array 24 and accessing, in an alternating fashion 
the lower dynamic buffer memories and the upper dy- 
5 namic buffer memories. In this manner, all the pixels 25 
in the array 24 can be accessed for retrieval or storage 
of data. y 

[0053] A method of imaging a scene of interest utiliz- 
ing the imaging system 22 will be described with refer- 
io ence to Fig. 9. At step 1 48, a photo signal is generated 
by a photodiode within a particular pixel of the imaging 
system 22 in response to a radiance from the scene of 
interest. The degree of radiance determines a magni- 
tude of the photo signal. At step 150, a duration of an 
™ exposure period is measured to determine the relative 
strength of the photo signal. The duration of the expo- 
sure period is defined by a fixed decrease in voltage of 
an exposure signal from a reset voltage to a reference 
voltage, wherein the rate of decrease is dependent on 
20 the magnitude of the photo signal. Next, at step 1 52, the 
duration of the exposure period is digitized into a digital 
value. The digitization of the exposure period duration 
is preferably performed within the pixel of the imaging 
system 22. At step 154, the digital value is stored in a 
2s memory associated with that pixel. In the preferred em- 
bodiment, the memory is located within a pixel array of 
the imaging system 22. 

30 Claims 

1. An imaging system (22) having a photosensitive ar- 
ea formed by an array (24) of pixels (25). each pixel 
comprising: 



35 



40 



45 



SO 



ss 



a photo sensor (36) for generating a photo sig- 
nal that is responsive to an intensity of incident 
light on said pixel, said intensity of incident light 
corresponding to a degree of radiance from a 
scene of interest; and 

a converter (38, 40, 68 and 78) operatively con- 
nected to said photo sensor for forming a time- 
dependent signal as a function of variable 
length exposure periods of said photo sensor, 
said variable length exposure periods having 
durations that are based on a mathematical re- 
lationship with magnitudes of said photo signal 
such that said time-dependent signal is repre- 
sentative of said intensity of incident light. 

2. The system of claim 1 wherein said photo signal is 
an analog signal and said converter (38, 40, 68 and 
78) is connected to receive said analog photo signal 
and generate said time-dependent signal in a digital 
format. 

3. The system of claim 1 or 2 wherein said converter 
(38, 40, 68 and 78) includes circuitry (38) for deter- 
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mining said durations of said variable length expo- 
sure periods in accordance with detecting a prese- 
lected voltage drop induced by said incident light. 

4. The system of claim 1 or 2 wherein said converter s 10. 
(38, 40, 68 and 78) includes a comparator (38) elec- 
trically coupled to said photo sensor for comparing 

an integration signal with a reference signal, said 
circuitry generating a termination signal when a 
magnitude of said integration signal has become 
equivalent to a magnitude of said reference signal, 
said integration signal having a rate of change de- 
fined by said magnitudes of said photo signal. 

5. The system of claim 1 , 2, 3 or 4 further comprising 
a plurality of memory cells (82 and 84) connected 
to said converter to store bits of a digital value of 
said time-dependent signal, said memory cells be- 
ing electrically coupled to corresponding bi-direc- 
tional bit lines (78), each of said corresponding bi- 
directional bit lines configured to transfer data from 
and to one of said memory cells. 

6. A method of imaging a scene of interest comprising 
steps of: 

generating (148) a photo signal in an analog 
format at a pixel region (25) of an imaging sen- 
sor (22), said photo signal being responsive to 
an intensity of incident light sensed at said pixel 
region; 

measuring (1 50) a duration of an exposure pe- 
riod to determine said intensity of incident light, 
said exposure period being variably dependent 
on a magnitude of said photo signal; and 
digitizing (152) said duration of said exposure 
period as digital data, including storing (154) 
said digital data in a memory (40) of said imag- 
ing sensor 

7. The method of claim 6 wherein said step of meas- 
uring (150) said duration of said exposure period 
includes monitoring (44) a change of an exposure 
signal that is allowed to dissipate, said change hav- 
ing a rate (16, 18 and 20) of decrease that is de- 
pendent on said magnitude of said photo signal. 

8. The method of claim 7 wherein said step of moni- 
toring (44) said change of said exposure signal in- 
cludes comparing (38) said exposure signal to a ref- 
erence signal, said reference signal serving as a 
threshold level for said exposure signal to define an 
end of said exposure period. 

9. The method of claim 6, 7 or 8 wherein said step of 55 
digitizing (152) said duration of said exposure peri- 
od includes employing a plurality of dual port mem- 
ory cells (82 and 84) and associated bi-directional 



bit lines (78), each said bi-directional bit line being 
configured to transfer data from and to one of said 
dual port memory cells. 

The method of claim 6, 7, 8 or 9 wherein said step 
of digitizing (1 52) said duration of said exposure pe- 
riod includes executing said step of digitizing said 
duration of said exposure period within said pixel 
region (25). 
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